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Abstract 

A common optimization problem is the minimization of a symmet- 
ric positive definite quadratic form {x, Tx) under linear constrains. The 
solution to this problem may be given using the Moore-Penrose inverse 
matrix. In this work we extend this result to infinite dimensional com- 
plex Hilbert spaces, making use of the generalized inverse of an operator. 
A generalization is given for positive diagonizable and arbitrary positive 
operators, not necessarily invertible, considering as constraint a singular 
operator. In particular, when T is positive semidefinite, the minimization 
is considered for all vectors belonging to J\f{T)^ . 
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1 Introduction 

Quadratic forms have played a central role in the history of mathematics, in 
both the finite and the infinite dimensional case. Many authors have studied 
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problems on minimizing (or maximizing) quadratic forms under various con- 
strains, such as vectors constrained to lie within the unit simplex (Broom [S]). 
A similar result is the minimization of a more general case of a quadratic form 
defined in a finite-dimensional real Euclidean space under linear constraints (see 
e.g. La Cruz 13 , Manherz and Hakimi |15j). with many applications in net- 
work analysis and control theory. In a classical book of Optimization Theory by 
Luenberger [14j . various similar optimization problems are presented, for both 
finite and infinite dimensions. 

In the field of applied mathematics, a strong interest is shown in applications 
of the generalized inverse of matrices or operators. Various types of generalized 
inverses are used whenever a matrix/ operator is singular, in many fields of 
both computational and also theoretical aspects. An application of the Moore- 
Penrose inverse in the finite dimensional case, is the minimization of a symmetric 
positive definite quadratic form under linear constrains. This application can be 
used in many optimization problems, such as electrical networks ( Ben- Israel 
[2]), finance (Markowitz [161 [17] ) etc. A similar result for positive semidefinite 
quadratic forms with many applications in Signal Processing is presented by 
Stoica et al [18], Gorkhov and Stoica [lO] . 

In this work we extend the result of Ben- Israel [2] for positive operators acting 
on infinite dimensional complex Hilbert spaces. We will consider the quadratic 
form as a diagonizable, diagonal or a positive operator in general, not neces- 
sarily invertible. In the case of a positive semidefinite quadratic form, another 
approach proposed for this problem is the constrained minimization to take 
place only for the vectors perpendicular to its kernel. This can be achieved 
using an appropriate decomposition of the Hilbert space. 

Another possible candidate for this work would be the class of compact self 
adjoint operators, making use of the spectral theorem. Unfortunately, compact 
operators do not have closed range, therefore their generalized inverse is not a 
bounded operator. 
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2 Preliminaries and notation 



The notion of the generahzed inverse of a (square or rectangular) matrix was 
first introduced by H. Moore in 1920, and again by R. Penrose in 1955. These 
two definitions are equivalent, and the generalized inverse of an operator or 
matrix is also called the Moore- Penrose inverse. It is known that when T is 
singular, then its unique generalized inverse (known as the Moore- Penrose 
inverse) is defined. In the case when T is a real r x m matrix, Penrose showed 
that there is a unique matrix satisfying the four Penrose equations, called the 
generalized inverse of T, noted by T^. 

In what follows, we consider H a separable infinite dimensional Hilbert space 

and all operators mentioned are supposed to have closed range. 

The generalized inverse, known as Moore-Penrose inverse, of an operator T £ 

B(T-L) with closed range, is the unique operator satisfying the following four 

conditions: 

where T* denotes the adjoint operator of T . 

It is easy to see that TT^ is the orthogonal projection of T-L onto Tl{T) , denoted 

by Pt, and that T^T is the orthogonal projection of Ti. onto Tl{T*) noted by 

Pt*. It is well known that 7^(^t) = 7^(^*) , and that = (r*T)^i|K(T.)T*. 

It is also known that is bounded if and only if T has a closed range. 

If T has a closed range and commutes with T^, then T is called an EP operator. 

EP operators constitute a wide class of operators which includes the self adjoint 

operators, the normal operators and the invertible operators. 

Let us consider the equation Tx ~ b,T E B{T-L), where T is singular. If 6 ^ 

then the equation has no solution. Therefore, instead of trying to solve the 

equation \\Tx — b\\ = 0, we may look for a vector u that minimizes the norm 

||Tx— &II . Note that the vector u is unique. In this case we consider the equation 

Tx — PR(T)b, where Prit) is the orthogonal projection on TZ{T). 

The following two propositions can be found in Groetsch [9 and hold for oper- 
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ators and matrices: 



Proposition 2.1 Let T e B{H) and b E H. Then, for u E H, the following are 
equivalent: 

(i) Tu^ PB.{T)b 

(ii) llTu- 6|| <|| Ta;- 6||,Va; G U 
(Hi) T*Tu ^ T*b 

Let M = {u e n\T*Tu = T*b}. This set of solutions is closed and con- 
vex, therefore, it has a unique vector with minimal norm. In the literature, 
GroetschjQj, IB is known as the set of the generalized solutions. 

Proposition 2.2 Let T € B{U),h e U, and the equation Tx = b. Then, if T^ 
is the generalized inverse of T , we have that T% = u, where u is the minimal 
norm solution defined above. 

This property has an application in the problem of minimizing a symmetric 
positive definite quadratic form {x, Qx) subject to linear constraints, assumed 
consistent (see Theorem 12. 3p . 

We will denote by Lat T the set of all closed subspaces of the underlying Hilbert 
space % invariant under T. 

A self adjoint operator T E B{H) is positive when {Tx, x) > for all x E H. Let 
T be an invertible positive operator T which is diagonizable. Then, T — U*TkU 
where U is unitary and is diagonal, of the form 

Tfe(a;i,a;2, . . .) = {kiXi,k2X2, ■ ■ ■) 

where (fcn)n is a bounded sequence of real numbers, and its terms are the eigen- 
values of Tk, assumed positive. Its inverse T^^ is also a diagonal operator, with 
corresponding sequence k[ = 

When Tfc is singular, at least one of the fc^'s is equal to zero. Then, its Moore- 
Penrose inverse has a corresponding sequence of diagonal elements k[ defined as 
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follows: 



0, h^o 



Since all the diagonal elements are nonnegative, in both cases Tk has a unique 
square root r,„, which is also a diagonal operator with corresponding sequence 
iTT-n — VKi- Similar results concerning diagonizable and diagonal operators can 
be found in Conway [7]- 

As mentioned before, EP operators include normal and self adjoint operators, 
therefore the operator T in the quadratic form studied in this work is EP. An 
operator T with closed range is called EP if J\f{T) ~ J\f{T*). It is easy to see 
that 

± 



T EP ^ 7^(T) ^ niT*) n{T)®M{T) = n^ tt^ = t^t. 



(2) 



We take advantage of the fact that EP operators have a simple canonical form 
according to the decomposition T-L = TZ{T) (BJ\f{T). Indeed an EP operator T 
has the following simple matrix form: 

A 


where the operator A : TZ{T) TZ{T) is invertible, and its generalized inverse 
has the form 





(see Campbell and Meyer [6], Drivaliaris et al f8|). 

Another result used in our work, wherever a square root of a positive operator is 
used, is the fact that EP operators have index equal to 1 and so, Tl{T) = TZ{T^). 
(see Ben Israel pages 156- 157) 

As mentioned above, a necessary condition for the existance of a bounded gen- 
eralized inverse is that the operator has closed range. Nevertheless, the range 
of the product of two operators with closed range is not always closed. 
In Bouldin [4 an equivalent condition is given: 
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Theorem 2.3 Let A and B be operators with closed range, and let 

H, = N{A) n {N{A) n n{B))^ = N{A) e n{B) 

The angle between Hi and Ti-iB) is positive if and only if AB has closed range. 

A similar result can be found in Izumino this time using orthogonal pro- 
jections : 

Proposition 2.4 Let A and B be operators with closed range. Then, AB has 
closed range if and only if A'^ABB^ has closed range. 

We will use the above two results to prove the existence of the Moore- Penrose 
inverse of appropriate operators which will be used in our work. 
Another tool used in this work, is the reverse order law for the Moore-Penrose 
inverses. In general, the reverse order law does not hold. Conditions under 
which the reverse order law holds, are described in the following proposition 
which is a restatement of a part of R. Bouldin's theorem [5] that holds for 
operators and matrices. 

Proposition 2.5 Let A, B be bounded operators on % with closed range. Then 
{AB)^ ~ B"^ A^ if and only if the following three conditions hold: 

i) The range of AB is closed, 

ii) A^ A commutes with BB* , 
Hi) BB^ commutes with A* A. 

A corollary of the above theorem is the following proposition that can be found 
in Karanasios- Pappas [12^ and we will use it in our case. 

Proposition 2.6 Let A,T £ be two operators such that A is invertible 

and T has closed range. Then 

(TA^ =A-^T^ if and only if Ti{T) e Lat{AA*). 
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3 The Generalized inverse and minimization of 
Quadratic forms 



Let Q be a symmetric positive definite symmetric matrix. Then, Q can be 

written as Q = UDU*, where U is unitary and D is diagonal. 

Let denote the positive sohition of = D, and let D^^ denote {D^)~^, 

which exists since Q is positive definite. 

The following theorem can be found in Ben Israel [2]. 

Theorem 3.1 Consider the equation Ax — b . 

If the set S = {x : Ax = b} is not empty, the the problem : 

minimize{x, Qx), x € S 

has the unique solution 

X = UD-i{AUD~^)''b. 

3.1 Positive Diagonizable Quadratic Forms 

A generalization of the above theorem in infinite dimensional Hilbert spaces, 
is by replacing Q with an invertible positive operator T which is diagonizable. 
The operator A must be singular, otherwise this problem is trivial. Since T is 
diagonizable, we have that T — U*TkU. 

We need first the following Lemma. Note that in the infinite dimensional case 
the Moore-Penrose inverse of an operator is bounded if and only if the operator 
has closed range. 

Lemma 3.2 Let T G B{'H) be an invertible positive operator with closed range 
which is diagonizable and A G B{'H) singular with closed range. 
Then, the range of AU* X^^ is closed , where X is the unique solution of the 
equation X^ = Tk- 

Proof. Using Theorem \2.3[ the range ofU*X~^ is closed since Hi ~ Af{U*)Q 
TZ{X'^^) = 0, and so Hi is trivial, therefore the angle between U* and X^^ is 
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equal to ^. Hence, the range of AU*X ^ is closed because using proposition 
l2^\we can see that A'fA{U*X~^){U*X-^y = Pa*U*X-^XU = Pa- has closed 
range. □ 

We are now in condition to prove Theorem 13.31 

Theorem 3.3 Consider the equation Ax — h, with A G B{'H) singular with 
closed range and b CzH. 

If the set S = {x : Ax — b} is not empty, then the problem : 

minimize {x, Tx) ,x ^ S 

with T G BijH) an invertible positive diagonizable operator with closed range has 
the unique solution 

X = U*X-\AU*X-yb 
where X is the unique solution of the equation X^ — T^. 

Proof. The idea of the proof is similar to Ben Israel |2], but the existence 
of a bounded Moore- Penrose inverse is not trivial like in the finite dimensional 
case. 

It is easy to see that since T = U*TkU is positive, is also positive. Then, 

{x,Tx) = {x,U*TkUx) = {Ux,TkUx) = {Ux,X'^Ux) = 
{XUx,XUx) = {y,y) 

So, the problem of minimizing {x, Tx) is equivalent of minimizing {y, y) ~\\ y |p 

where y — XUx. We also have that y = XUx <^ x = U*X^^y. 

From proposition 12 . 21 we know that the minimal norm solution of the equation 

Ax — b is the vector x — A''b, so by substitution, AU*X^^y — b and the 

minimal norm vector y is equal to y = [AU* X^^]%, since AU*X^^ is a singular 

operator. 

Therefore, XUx = [AU*X-^]'^b ^x = U* X-^{AU* X-^)'^b 
□ 
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We can verify that the solution x = U*X ^{AU* X ^)'^h satisfies the constraint 
Ax^b : 

We have that Ax = AU* X-'^{AU* X-'^)'ih = SS% = Pgh, where S = AU* X-^ 
and we can see that 7?.(5) = Tl{AU* X^^) = Tl{A) since X and U are invertible. 
Therefore, Ps = Pa and P56 = Pa& = b since b e n{A). 
We can also compute the value of the minimum {x, Tx), x € S : 

{x,Tx) = {U* X-^{AU* X-'^)h,U*TkUU* X-'^{AU* X-^)h) = 

{{Au*x-yb,iAu*x-yb) =11 {Au*x-yb ip 

3.2 Positive Definite Quadratic Forms 

In this section we extend the results presented above, in the general case when 
T is a positive operator following the same point of view. 
Let T be a positive operator, having a unique square root R. 

Theorem 3.4 Consider the equation Ax — b, with A G B{'H) singular with 
closed range and b £ %. If the set S — {x : Ax — 6} is not empty, then the 
problem : 

minimize{x,Tx) , X Cz S 

with T G S('H) an invertible positive operator with closed range has the unique 
solution 

X = R-\AR-yb 

Proof. We have that {x,Tx) = {Rx,Rx) =|| Rx \\^^\\ y jp. So, 

Ax^b<:^y= [AR-yb ^ i = R-^{AR-yb 

It is easy to verify that the range of the operator AR^^ is closed, as in lemma 
[321 □ 

We can see by easy computations, that the minimum {x,Tx),x G S* is then 
equal to 

{x,Tx) = (R-\AR-^yb,R^R-\AR-^)^b) = 
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{iAR-^yb,iAR-^)^b) =11 {AR-^)^b f 

A natural question to ask, is what happens if the reverse order law for generahzed 
inverses holds. In this case, the solution given by Theorem l3.4[ using Proposition 
will be as follows: 



Corollary 3.5 Considering all the assumptions of Theorem \3.4\ let TZ{A) G 
Lat{T). Then, A'fb. 

The proof is obvious, since in this case, Lat{RR*) = Lat{R^) = Lat{T), and 
R-^{AR-^y = i?-ii?At 

We can also see that in this case, the minimum value of (x, Tx), x € S is equal 
to (At6,i?2^tfe) =11 nAfb ||2 

We will present an example for Theorem 13.41 and corollary 13.51 



Example 3.6 Let T : I2 ^ h ■ T{xi, X2, X3, . . .) = {xi, 2x2, ^3, 2x4 . . .) which 
is a bounded diagonal linear operator. 

Let L : I2 ^ I2 ■ L{xi, X2, x^, . . .) — {x2,X3, . . .), the well known left shift 
operator which is singular and S — {x : Lx = (1, i, i, i, . . .)}. Lt is also well 
known that L^ = R, the right shift operator. Since T is positive and invertible, 
the problem of minimizing {x,Tx) , x € S following Corollaru lS. 5\ has the unique 
solution X — (0, 1, i, i, i, . . .). 

Indeed, since Tl{L) — H — I2 which is invariant under T, we have that TZ{L) G 
Lat{T) and so 



. ..^t/ 111 , , 111 



Using this vector, we have that the problem of minimizing {x,Tx),x G S has a 
minimum value as shown in what follows: 

min{x,Tx) = {x,Tx) = ((0, 1, i, i, i, . . .), r(0, 1, ^, i, . . .)) = 

((0,1, .), (0,2, -,2x-,-,2x- . . .)) = 0+2xl+^+2x^+i+2x4 • ■ 
\V , '2' 3' 4' ''^ ' '2' 3' 4' 5 " 22 32 4 52 

El 1 _ TT^ _ In^ 

^ ^ ^ (2n + 1)2 ~ Y ^ T ~ "2r 

n=l n=0 ^ ' 
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This value is equal to || RA^b |p as presented in the above corollary, since in 
this case R{xi,X2,X3, ■ ■ ■) — {xi, y/2x2, X3, \/2x4 . . .) and 

II RA^b\M\RLHl,y-,\,...) + 1 + ^^+2.^ + 1 + ...^'-^ 

and this verifies Corollary \3.5[ 

We can see that the minimizing vector found by Theorem \3.4\ has the minimum 
norm among all possible solutions, of the form (c, 1, i, i, i, . . .), c G C , as 
expected. 

3.3 Positive Semidefinite Quadratic Forms 

We can also consider the case when the positive operator T is singular, that is, T 
is positive semidefinite. In this case, since Af{T) ^ 0, we have that {x,Tx) = 
for all X e Af{T) and so, the problem : 

minimize{x,Tx) , X € S 

has many solutions when JV{T) n 5 ^ 0. 

In Stoika et al |18j a method is presented for the minimization of a positive 
semidefinite quadratic form under linear constraints, with many applications 
in the finite dimensional case. In fact, since this problem has an entire set of 
solutions, the minimum norm solution is given explicitly. 

A different approach to this problem in both the finite and infinite dimensional 
case would be to look among the vectors x G 7V(T)^ = TZ{T*) = TZ{T) for a 
minimizing vector for {x,Tx). In other words, we will look for the minimum of 
{x,Tx) under the constraints Ax = 6,x G TZ{T). 

Using the fact that T is an EP operator, we will make use of the first two 
conditions in the following proposition that can be found in Drivaliaris et al [5] : 

Proposition 3.7 Let T G B{'H) with closed range. Then the following are 

equivalent: 

i) T is EP. 
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ii) There exist Hilbert spaces K\ and C\, U\ G B{K\ ® unitary and 

A\ e B{K\) isomorphism such that 

r = [/i(Ai®o)[/*. 

Hi) There exist Hilbert spaces /C2 and C2, U2 € B{K2® €-2,%) isomorphism and 
A2 G B(/C2) isom,orphism, such that 

T = U2{A2®0)Ul 

iv) There exist Hilbert spaces JC3 and £3, U3 e B(/C3 ©£3,'?^) injective and 
As e B(/C3) isomorphism such that 

T = U3{As(B0)U^. 

We present a sketch of the proof for (1)^(2): 

Proof. Let /Ci = 7^(^), £1 = Af(T), Ui-.Ki® Ci-^H with 

Ux{xx,X2) = X1+X2, 

for all xi e 7^(T) and X2 G Af(T), and Ai = T\ti(t) ■ ^ 7^(T). Since T is 

EP, TZ{T) 7V(r) = "H and thus Ui is unitary. Moreover it is easy to see that 
UiX — {PTX,Pjsf(T)x)^ for all x €%. It is obvious that Ax is an isomorphism. 
A simple calculation shows that 

T = f/i(Ai©0)?7i*. 

□ 

It is easy to see that when T ~ Ui{Ai ® 0)i7j* and T is positive, so is Ai, since 

{x,Tx) = {xi,AiXi),xi e TZ{T). 

In what follows, T will denote a singular positive operator with a canonical form 
T = U\{Ai © 0)t/i , i? is the unique solution of the equation = Ax and 

, r 
= 



As in the previous cases, since the two operators A and R are arbitrary, one 
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does not expect that the range of their product will always be closed. 
Using Proposition 13. 71 we have the following theorem: 

Theorem 3.8 Let T G B{'H) he an singular positive operator, and the equation 
Ax = b, with A £ B{'H) singular with closed range and h £ %. If the set 
S — {x £ Af{T)^ : Ax — 6} is not empty, then the problem : 

minimize{x, Tx) ,x £ S 

has the unique solution 

X = UiR^AUiR^^b 
assuming that Pa*Pt has closed range. 
Proof. We have that 
{x,Tx) = {x, Ui{Ai ® 0)U*x) = {U*x, {Ai ® 0)U*x) = {U*x, {R^ © 0)U*x) 

We have that U^x = {xi,X2) and {U^x, {Ai © 0)U^x) = {xi,AiXi),xi e 7^(T). 
Therefore {x,Tx) = {{R ® 0)U^x, {R Q) 0)U^x) = {Rxi,Rxi) = {y,y) , where 
y = Rxi, with xi G 7V(T)^. 

The problem of minimizing {x,Tx) is equivalent of minimizing \\ y |p where 
y^Rx-^^ {R®0)U^x ^x = Ui{R-^®0)y = UiR'^y. 
As before, the minimal norm solution y is equal io y — [AUiR'^]'^h. 
Therefore, xi ^ UiR^f {AUiR'^yb, with x\ € S. 

As in Theorem 13.31 . we still have to prove that AUiR'' has closed range. 
Using Theorem 12.31 the range of [/li?^ is closed since 

H, = JV{U*) n {Af{u*) n 7^(i?t))^ = o 

and so the angle between U* and R^ is equal to f . 

From Proposition 12 .41 the operator Pa-Pt must have closed range because 

AtAC/ii?t(C/ii?t)t = Pa.UiPrUI = Pa'UiPa.UI = Pa-Pt 

making use of Proposition 12.61 and the fact that TZ{R) = TZ{Ai) = TZ{T). 
□ 
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Corollary 3.9 Under all the assumptions of Theorem \y.8\ we have that the 
minimum value of f{x) = {x,Tx),x G S is equal to \\ {AUiR^yb |p 

Proof We have that 

frmnix) = {x,Tx) = {UiR^AUiR^ ^ b,TUiR\AUiR^ )^ b) 

Since T = q o)u* we have that 

fm^n{x) = {UiR^ {AUiR^ )^ b, UiiR ® 0){AUiR^ )^ b) = 

{PTiAUiR^)^b, [AUiR^^b) =11 {AUiR^)^b f 

since 

and 7^(yl[/li?t)t = 7^(A^7li^t)* = 7^(i?C/lA*) C n{R) = n{T), therefore 

PT{AUiR^)h^ {AUiR'')'^b 



In the sequel, we present an example which clarifies Theorem 13 . 81 and Corollary 
13.91 In addition, the difference between the proposed minimization {x e JV{T)^) 
and the minimization for all x € H is clearly indicated. 

Example 3.10 Let % = Ti? , and the positive semidefinite matrix 

14 20 28 

20 83 40 

28 40 56 

We are looking for the minimum of f{u) — u'Qu,u G Af{Q)^ under the con- 
straint 2x + 2y — z = 10. 

Then, all vectors u G M{Q)^ have the form u — (x, ?/, 2x). The matrices U, i?^ 
are 



U 



-0.2926 0.3382 -0.8944 
-0.7563 -0.6543 
-0.5852 0.6764 0.4472 



R^ 



0.0907 
0.1787 
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Using theorem \3.8\ we see that the minimizing vector of f{u) under Au = b,u G 



Af{Q)^, where A = 



2 1 



and b = 10, is 



= C/ii?^(yl[/ii?t)t6 ^ (-2.8572, 10, -5.7143) 



The minimum value of f{u) is then equal to 5J^J^2.9 

We can verify that it is equal to the minimum value found in Corollary \3.9l 
II {AUiR^)''bf^\\ (-37.313,-63.644,0)11^= 5442.9 



This example can be represented graphically as follows, clearly showing the con- 
strained minimization and the uniqueness of the solution: 




-20 -20 "'i I I I I I I I I 

^ 20 -15 -10 -5 5 10 15 



Figure 1: Constrained minimization of u'Qu, u £ M{Q) 



In the case of the minimization of f{u),u € TZ^ : Au — b, then the set 

5' = {w e N{Q) -.Au^b] 

is nonempty. 

The vector v — (4,0,-2) belongs to S' and therefore, f{v) = 0. The same 
answer would be given using the algorithm proposed by Stoika et al 1181. 
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4 Conclusions 



In this work wc extend a minimization result concerning non singular quadratic 
forms using the Moore-Pcnrose inverse, to infinite dimensional Hilbert spaces. In 
addition, in the case of a singular quadratic form the minimization takes place 
for all its non zero values. This proposed Constrained minimization method 
has the advantage of a unique solution and is easy to implement. Practical 
importance of this result can be in numerous applications such as filter design, 
spectral analysis, direction finding etc. In many of these cases the quadratic form 
may be very close to, or even exactly singular, and therefore the knowledge of 
the non zero part of the solution may be of importance. 

References 

[1] A. Ben-Israel and T. N. E. Grenville (2002). Generalized Inverses: Theory 
and Applications, Springer- Verlag, Berlin. 

[2] A. Ben-Israel. A. Charnes (1963). Generalized Inverses and the Bott-DufRn 
Network Analysis, J. Math. Analysis and AppL, (7), pp. 428- 435. 

[3] R. Bouldin ( 1973). The pseudo-inverse of a product, SIAM J. Appl. Math. 
24 (4) pp. 489-495. 

[4] R. Bouldin ( 1973). The product of operators with closed range, Tohoku 
Math. J. 25 (4) pp. 359-363, . 

[5] M. Broom (1993). On the number of local maxima of a constrained 
quadratic form, Proc. Roy. Soc. London Ser. A 443 , no 1919, pp. 573- 
584. 

[6] S. L. Campbell and C. D. Meyer (1979). Generalized inverses of Linear 
Transformations, Dover Publ. New York. 

[7] J. Conway (1985). A course in functional analysis, Springer Verlag New 
York. 



16 



[8] D. Drivaliaris, S. Karanasios, D. Pappas (2008). Factorizations of EP op- 
erators, Linear Algebra Appl. 429 pp. 1555-1567. 

[9] C. W. Groetsch (1977). Generalized inverses of linear operators, Marcel 
Dekker Inc. New York. 

[10] A. Gorokhov, P. Stoica (1998). Generalized quadratic minimization and 
signal processing applications, EUSIPCO '98, 9th European Sign. Proc. 
Conference, Rhodes, Greece . 

[11] S. Izumino(1982). The product of operators with closed range and an ex- 
tension of the reverse order law, Tohoku Math. J. 34, 43-52. 

[12] S. Karanasios , D. Pappas (2006). Generalized inverses and special type 
operator Algebras, Facta Univ. Ser. Math. Inform., (21), pp. 41-48. 

[13] W. La Cruz (2009). Extension of the Barzilai- Borwein method for 
quadratic forms in finite Euclidean spaces. Numer. Funct. Anal. Optim. 
30 (3- 4) pp. 306-321, . 

[14] D. Luenberger (1969). Optimization by Vector Space Methods, Wiley Publ. 
New York. 

[15] R. Manherz, S. Hakimi (1969). The Generalized Inverse in Network Anal- 
ysis and Quadratic- Error Minimization Problems, IEEE Trans. Circuit 
Theory, vol. 16 (4), pp. 559- 562. 

[16] H. Markowitz (Mar. 1952). Portfolio Selection. J. Finance, 7, No.l. , pp. 
77-91. 

[17] H. Markowitz (1959). Portfolio Selection. Cowles Foundation Monograph 
N.16. New York John Wiley and Sons Inc. 

[18] P. Stoika, A. Jakobsson, J. Li (1996). Matrix Optimization Result with 
DSP Applications. Dig. Signal Proc, A review Journal, 6 , pp. 195- 201. 



17 



